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Abstract 

The purpose of this White Paper of the EU Support Action "Visioneer" (see www.visioneer.ethz.ch) 
is to address the following goals: 

1. Identify new ways of publishing, evaluating, and reporting scientific progress. 

2. Promote ICT solutions to increase the awareness of new emerging trends. 

3. Invent tools to enhance Europe's innovation potential. 

4. Develop new strategies to support a sustainable technological development. 

5. Lay the foundations for new ways to reach societal benefits and respond to industrial needs using 
ICT. 

1 Introduction 

The way in which science is organized today has largely missed to use the opportunities of the information 
revolution, particularly the Web2.0. It will therefore be discussed which parts of scientific knowledge 
creation and spreading need to be improved or reinvented, what tools are available, and which ones need 
to be created to achieve the required changes. 

Problems have become apparent in particular in the social and economic sciences, which are facing 
emerging challenges at an accelerating rate. President Lee C. Bollinger of New York's prestigious Columbia 
University described the situation as follows: "The forces affecting societies around the world ... are 
powerful and novel. The spread of global market systems ... are ... reshaping our world raising profound 
questions. These questions call for the kinds of analyses and understandings that academic institutions are 
uniquely capable of providing. Too many policy failures are fundamentally failures of knowledge" This 
has become particularly apparent during the recent financial and economic crisis, which is questioning 
the validity of mainstream scholarly paradigms. Given the impact that the financial crisis has had on 
economies and societies all over the world — and will have for many more years — it appears necessary 
to get from a situation of doing the aftermath of crises into a position of being able to anticipate and 
mitigate them efficiently, which also calls for contingency plans and the exploration of alternatives 0. 

Altogether, this requires to close a number of knowledge gaps and to accelerate the rate of knowledge 
creation, taking into account the wisdom obtained in other research fields. In other words, it seems appro- 
priate to pursue a multi-disciplinary approach, involving researchers and methods from other disciplines, 
and to establish new institutional settings which remove or reduce obstacles impeding efficient knowl- 
edge creation. While the first part of this White Paper will make suggestions on how to modernize and 
improve the academic publication system, the second part will address the issue of supporting scientific 
coordination, communication, and co-creation in large-scale multi-disciplinary projects. Both constitute 
important elements of what we envision to be an "Innovation Accelerator" or "Knowledge Accelerator" . 
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2 Identify new ways of publishing, evaluating and reporting sci- 
entific progress 

2.1 Stylized characterization of the current situation 

The way in which the current publication system works dates back to times where 

1. scientists were a small and hand-selected elite, 

2. the creation of papers was a cumbersome and slow process (using type- writers) , 

3. the publication of papers was quite expensive, 

4. the world was changing at a relatively slow pace as compared to today, 

5. coherent scientific paradigms could only be reached by a selection process that may be compared 
with cultivating a garden or forest (planting certain flowers or trees and removing others that did 
not fit well). 

Before we describe the paradigm shift that current and future information system will bring about 
regarding the way in which we create, disseminate, select, and harvest knowledge, let us start with 
highlighting some side effects that the present publication system seems to have (of course, not always, 
but tendcntially): The conventional way of spreading scientific knowledge is passing through the system 
of peer-reviewed journal^. This means that the publication process is slow and that valuable information 
may be lost in the selection process. Surprisingly, despite a considerable literature, there is little sound 
peer-review research examining criteria or strategies for improving this process Q . 

Before introducing the concepts of a Science 2.0 framework (Scc. l2.2| ) and of the Innovation Accelerator 
(Sec. I4.2j) . let us first discuss some problems of the selection process, which is based on the idea that 
there are good and bad papers, and that they may be well distinguished from each other. However, any 
classification process suffers from errors of first and second kind, i.e. bad contributions may be accepted 
and good ones may be rejected. Misclassifications occur not only due to occasional conflicts of interest. 
As the manuscript assessment is based on small numbers and as referee opinions vary dramatically in 
many casesQ, the statistical validity of the individual manuscript selection process is rather questionable. 
In this context one should mention recent results of computer simulation indicating that a fraction of 
only 30% "rationally behaving" referees (rejecting all papers which do not promote their own interest) 
is sufficient to bring down the quality of peer-review to pure random selection Q. This underlines how 
sensitive the results of peer review are to the choice of referees. 

What is worse is the fact that referees often do not agree on what is a good or a bad paper (e.g. some 
social scientists prefer detailed models with many parameters, others prefer minimalistic models with a few 
parameters only, and again others do not consider mathematical models appropriate at all to understand 
social systems). The consistency of evaluations largely depends on the homogeneity of a scientific field 
and its standardization. For example, although interdisciplinary contributions are considered to be highly 
desirable, they typically face more difficulties to pass the referee process. This increases their publication 
times, reduces their average impact, and discourages many scientists from doing multi-disciplinary work. 

Moreover, the judgement of what is a good model or a bad one may change over time, while we often 
imagine that science would reveal universal, ever-lasting truths. It is even quite questionable whether 
one universal and consistent theory exists at all. If it did exist, it is not clear whether it would be 
dccidablc which is the right theory, given the large level of heterogeneity and randomness in human 
decision-making and behavior Q. In fact, the success of scientific theories is often determined by herding 



x At least this is valid for the natural sciences and part of the social sciences, in the humanities still book production is 
important 0| 



3 



effects and scientific fashions, and it appears to have a iot to do with sociai networking, not oniy with 
the brilliance or deepness of an idea. 

Prominent examples of milestone papers which have been rejected are: 

• in mathematics: Mordell's conjecture, which was later proved by Falting, winning him the Fields 
Medal, 

• in physics: Enrico Fermi's paper predicting the existence of neutrinos, 

• in chemistry: the paper on the Bclousov-Zhabotinski reaction, 

• in economics: numerous examples are discussed in Ref. 

It is not known how many great inventions have never gained the attention of a wider audience. The 
problem has probably increased with the recent policy of desk rejection by Nature, Science, PNAS, and 
numerous other journals. It is said that, due to the often unpredictable outcome of review procedures at 
high-impact journals and in order to escape the potential slow-down and copying through competitors, 
Nobel prize winners in high-temperature supraconductivity have chosen to publish in a low-impact journal 
(Zeitschrift fur Physik) and to provide the correct chemical formulas only in the final page proofs. A similar 
strategy is said to have determined the Nobel prize winner for the discovery of quarks in elementary 
particle physics. 

It is, therefore, no wonder that the current peer-review system has been many times accused of lacking 
transparency, reliability, and fairness, discouraging scientific collaborations rather than encouraging them, 
and supporting methods and mechanisms which have been referred to as "feudal" lil Hot . Only 8% 
members of the Scientific Research Society agreed that 'peer review works well as it is.' Moreover, 



according to Horrobin 12[ "A recent U.S. Supreme Court decision and an analysis of the peer review 
system substantiate complaints about this fundamental aspect of scientific research." The paper concludes 
that peer review "is a non-validated charade whose processes generate results little better than does 



chance". A more differentiated picture is given by a recent survey study 13 1. 

For illustration, the current publication system may be compared to a funnel with a very small hole at 
its bottom, distilling very parsimoniously drops of knowledge. It is questionable, however, whether creating 
an artificial scarcity of research space is still justified in the age of electronic publication, particularly at 
times where the urgency to find solutions to world's problems would rather appear to suggest the use 
of a filter or colander. In certain academic environments the publication system is a real bottleneck for 
innovation today. 

As indicated before, publication, particularly in the social and economic sciences, is a slow process 
which often takes two or three years, given the manuscript is accepted by the first journal. This may 
well be slower than the world is changing. In case the paper is rejected and subsequently submitted to 
another journal, further precious time is wasted along the way between the formulation of an idea and its 
dissemination. Moreover, it is not exceptional that innovative contributions are not even considered for 
publication, particularly when they do not fit the mainstream theories and trends covered by a journal. 

Also Albert Einstein had to suffer of the opposition of many established colleagues, before finally 
receiving the deserved credit for his theory of relativity. Anecdotally, his response to the booklet "100 
Authors Against Einstein" was: "Why 100 authors? If I were wrong, then one would have been enough!" , 
but not everybody has his standing. Many authors instead follow scientific trends, and mainstream 
economics is probably the best example of a field where researchers have been more impressed by brilliant 
ideas of their colleagues than by economic data. It is this herding effect which lets science progress 
through a succession of revolutionary paradigm shifts fl4| and which made Max Planck believe that 
"Science progresses funeral by funeral" . Even thought empirical evidence seems to support a somewhat 



more optimistic view regarding the spreading of new ideas |15l ] , it is hard to deny a tendency towards 



large delays and substantial inertia in the adoption of new knowledge certainly exists. 
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Since Max Planck's famous quote, more than 50 years have passed, but the situation has not changed 
much. The reward structure of the scientific system, particularly the orientation at high citation rates, 
rather tends to reinforce herding effects, while fundamental innovations start off as minority ideas and 
may take a long time to be taken up, particularly if they do not happen to be promoted by big players 



Hence, the current publication system is slowing down scientific innovation, but not only this. 

1. It discourages the replication of results due to a lack of novelty, although replicability is considered 
to be a fundamental pillar of modern science. 

2. Many journals tend not to publish papers contradicting previously published results, since this may 
question the editorial process. If controversial contributions arc not rejected by the editorial desk, 
they are often stopped by the referees. 

3. Most journals do not publish commentaries or methodological contributions which could point out 
weaknesses of current results and questions ("grand challenges") which should be addressed. 

4. It is almost impossible to publish negative results, i.e. studies that did not deliver the results one was 
looking for. However, describing a model or experiment that failed would avoid similarly fruitless 
attempts and could help to identify successful variants more quickly. The Journal of Negative Results 
in Biomedicinefi^i is one of the rare exceptions publishing "unexpected, controversial, provocative 
and/or negative" results. 

All these circumstances slow down science and do not use resources (funding and manpower) efficiently. 
In particular, it can take a long time until incorrect or useless results are revealed, and generations of 
PhD students may be wasted on paths which eventually turn out to be dead ends. If the publication 
system could be changed such that important results would be confirmed more quickly, authors would 
be more careful to make sure their results are replicable. Also, scientific fraud would be discovered much 
earlier. 

In summary, the way in which science is organized today docs not appear to promote the efficient 
collaborative solution of problems that humanity is facing. First of all, there are only few methodological 
contributions which identify and raise the crucial questions. Second of all, the system is more compet- 
itive than what seems to be good for collaboration. The research and publication process is slow and 
wastes resources. Multi-disciplinary contributions, although urgently needed, often do not make it into 
high-impact journals. In fact, for interdisciplinary work and socio-economic contributions, the current 
publication system lacks established science journals beyond Nature, Science and PNAS with a reward- 
ing impact factor. Moreover, mostpapers that do successfully pass the review process are never read 
or cited [13]. According to Meho (l9| . "Only 50% of (accepted) peer-reviewed articles are ever read by 
someone other than the authors and the reviewers. Furthermore, 90% of articles are never cited." 

Heterodox contributions have particular difficulties to be published and noticed. Furthermore, scien- 
tific controversies tend to be discouraged, although they would probably be very stimulating. Finally, a 
curiosity of the scientific production system is that, in contrast to many other creative areas, authors 
write (and review) for free, while their institutions pay a high price to be able to read contributions 
of others. Alternatively, if they want to make their contributions freely available to everyone (including 
smaller universities and less developed countries), they have to pay a considerable price for open-access 
publication. 

2.1.1 Emerging trends in scientific publication 




Recently, an intense discussion about the future of scientific publishing has set in. This is reflected by a 
number of contributions and events d, [H El, [lOJSJglJp, H3 and by the fact that Europe has 
lately been funding projects addressing this issue 2q. |27I. |28|. 
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This has also created a number of changes in the publication landscape and the behavior of scien- 
tists. For example, preprints of publications are now often uploaded to electronic archives before their 
acceptance and publication in a journal. The most well-known example is probably arXiv.org (29j . Some 
communities, such as in high-energy physics, seem to have even replaced journal publications by archive 
publications to a certain extent. Archives are also more and more used in the social sciences (e.g. SSRN 



In an analysis of the advantages of open access publishing in High Energy Physics (HEP), Gentil- 
Bcccot et al. 311 summarize: 




• "Submission of articles to an Open Access subject repository, arXiv, yields a citation advantage of 
a factor of five." 

• The citation advantage of articles appearing in a repository is connected to their dissemination prior 
to publication, 20% of citations of HEP articles over a two-year period occur before publication. 

• HEP scientists are between four and eight times more likely to download an article in its preprint 
form from arXiv rather than its final published version on a journal web site." 

As a consequence, they conclude: 

• "There is an immense advantage for individual authors, and for the discipline as a whole, in free 
and immediate circulation of ideas, resulting in a faster scientific discourse." 

• "Peer-reviewed journals have lost their role as a means of scientific discourse, which has effectively 
moved to the discipline repository." 

However, what worked in the wcll-nctworkcd HEP community docs not seem to be directly transferable 
to other disciplines. In areas different from particle- and astro-physics, arXiv does by far not cover 100% 
of published papers, and the fraction of manuscripts uploaded there is apparently not converging to full 
coverage Also the establishment and spreading of recent public access journals (such as the Public 
Library of Science, PLoS) and of public access options of classical journals suggests that there is still 
a considerable interest in journal publications. This may relate to the promise of publishers to keep 
scientific results accessible over long time periods (over which old file formats may disappear and new 
ones may become temporary standards). Moreover, journals seem to play a role in terms of dissemination 
(marketing) . 

2.2 Science 2.0: A new open framework for scientific publication 

While facing the intricate challenges of our century, such as AIDS, cancer, climate change, the financial 
crisis, poverty, etc., it is our responsibility to make sure that available knowledge is recognized and used, 
and that new progress is made efficiently. In order to accomplish this, we need to create suitable ICT 
systems to produce, share, filter, combine and present scientific discoveries. This is only slowly happening 
in science. We are still wasting time due to the wide application of outdated concepts, technologies, and 
incentives. In the following, we will sketch a concept that shows how current journals may be developed 
further, combining the advantages of classical journals and archives, and providing community-based 
quality selection mechanisms to discover the pearls among a large quantity of scientific contributions. In 
fact, suitable filtering and discovery techniques may replace the practise of excessive review and revision 
procedures (which are very time consuming for scientists today), cutting them back to a reasonable level. 
A journal of the envisioned kind may be multi-disciplinary in nature and imagined as outlined in the 
following subsections. 
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2.2.1 Archiving 

The basis of the proposed journal of the future would be an archive, where manuscripts could be up- 
loaded by authenticated users. To save hardware and maintenance costs, the archive could be based on 
a decentralized platform such as a peer-to-peer system. If several preprint platforms are used in parallel, 
interoperability would be a desirable feature. A search engine for scientific papers would then pull the 
information from all platforms together and integrate them in one portal. It would be able to present the 
search results in a unified way. 

As soon as a manuscript is uploaded to any of these archives, it would become available for public 
download world-wide. As orientation for users, a usage statistics could be provided (number of views, 
number of downloads, etc.), reflecting the popularity of the paper. However, to avoid intensifying the 
Matthew effect [IH beyond what seems to be useful, it would make sense to randomize the order of 
display to a certain degree. 

According to the storage mechanism of the decentralized archive, papers that have not been accessed 
for a long time would lose visibility, while frequently accessed papers would gain visibility (and could be 
downloaded more quickly). 

2.2.2 Peer Review 

Today's peer review system tends to overload referees with papers they may not even be interested in 
reading (remember that most published papers are never downloaded or cited, see above). Therefore, in 
future not all manuscripts (preprints) should be reviewed anymore. However, in order to promote scientific 
quality, specialized editors would select certain archive contributions (preprints) for an anonymous peer 
review procedure. Reviews may also be submitted by readers. In this way, a top-down selection would be 
combined with a bottom-up ("grass-roots") procedure, given some mechanisms to ensure quality control. 

Referees would be asked to make critical contributions which help the authors to improve the quality 
of the manuscript in a revision round. Papers which had at least one positive report out of three would 
be considered for revision, given the positive referees have enough reputation points (see Sec. I2.2.8[) . 
The anonymous referees would write comments on the revised manuscript, which are published in an 
electronic journal together with the paper and with replies of the authors to these comments (given there 
was a positive editorial board decision based on the referee comments, author replies and revisions, which 
would be the standard case). Moreover, journal papers would get an initial rating by the referees and 
editorial board. In other words, a quality improvement mechanism would apply, but the publication of 
potentially valuable scientific contributions would not be suppressed. 

The new assessment procedures would make sure that scientific journal publications would have high 
standards and that the scientific debate would be stimulated. Referees would identify the weak points of 
a manuscript, while authors would have full responsibility for their quality and a fair chance to refute 
criticism. Rejected contributions would remain in the archive and be publicly accessible for a long time. 
All relevant agents in this process (i.e. authors, referees, and editors) would be rated (see below), i.e. 
they could gain or lose reputation depending on the quality of their work. The risk of negative ratings, 
comments, or replies would encourage everyone to do their job well. 

2.2.3 Journals 

Based on the wide range of disciplinary and multi-disciplinary contributions undergoing the peer-review 
procedure, different kinds of disciplinary journals should be created to target certain readerships. Multi- 
disciplinary contributions could appear in different disciplinary journals. These journals would usually 
appear in print (printed information has probably still the longest survival time over a period of several 
hundred years) . A small subset of contributions would additionally be highlighted by "best-of editions" or 
"editor's choices" . These would serve similar functions as today's letter magazines, trying to promote the 
rapid communication of particularly important results, but they would not suffer from space limitations. 
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Journals would also stimulate scientific debates and organize contributions according to different 
paper categories (see Sec. 12.2. 5p . Besides supporting a wider scope of contributions, journals could be 
improved in a number of ways, building on opportunities offered by what is called the Web2.0. A list of 
various Wcb2.0 tools and platforms for science is provided in the Appendix [B] These technologies could, 
for example, be used for an individually customized information filtering and retrieval system, and to 
support scientific convergence by interaction rather than selection. In fact, repeated social interaction is 
known to support the convergence of ideas in a natural way [3^ | . A proposal of how a journal could be 
made up in the era of Wcb2.0 is presented in the next section. 



2.2.4 Web article presentation 

Journals should present each reviewed paper on a dedicated Wcb2.0-like portal, which would be a Web 
environment stimulating the scientific discussion of scientific subjects. Comments and replies relevant 
to the topic should be supported. Comments would usually not be anonymous, but in certain cases 
this may be acceptable. To avoid inappropriate content, anonymous comments would be monitored by 
moderators chosen by the editorial board. Discussion should be stimulated by implementing suitable 



incentives schemes for contributions 35j, |36( (for example, the reputation system outlined in Sec. 12.2.8]) . 

One crucial feature of the Web2.0 platform would be to support the rating of articles, authors, referees, 
and editors. These ratings could be carried out by registered users and they would be visible to everyone. 

The Web page would link a publication to related contents such as 

• older versions of the same article (visual diff tools could help to highlight changes between different 
versions) , 

• related multimedia files and other supplementary materials, 

• cited articles and, even more importantly, missing citations as determined by a suitable algorithm, 

• the dataset used, 

• related materials as listed in Sec. 12.2.51 



The Web2.0 platform should also be endowed with a recommender system, indicating in particular 
relevant contributions from other fields (see Sec. I2.2.9p . It should furthermore provide a forum for the 
discussion of work in progress (something like question and answer channels, which could be run by 
subject-specific user groups). 



2.2.5 Paper categories 

In the age of electronic publication, the dissemination of information has become much cheaper, and 
there is no limitation of pages. Besides, it would be easy to create a network of interrelated contributions. 
When doing so, a number of different categories should be distinguished: 

• Original research papers, reporting results of recent studies (which is the only or at least the main 
category of most journals), 

• proposals and methodological papers, identifying research needs and elaborating important ques- 
tions, e.g. scientific grand challenges, 

• review papers, summarizing the progress in a field, 

• opinion contributions, allowing for subjective judgements, 

• summaries, such as conference reports or book reviews, insights into other fields, etc., 
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• replications reporting an independent confirmation of a result, preferably with another method, 

• contradictions which report results that are inconsistent with previously reported findings, 

• negative results reporting unexpected failures one may learn from, 

• errata (corrections of previously published results, e.g. mistakes that were made in calculations), 

• controversies which would promote a critical dialogue between different points of views on a certain 
subject, 

• blogs and podcasts, highlighting particularly relevant advances, 

• interviews, asking for points of views on certain subjects and revealing implications of certain 
findings, e.g. for society, technology, and economy, 

• comments and replies (discussions) which reflect on any of the other categories. 

All these contributions, linked in a network-like structure, could be supported by a set of digital libraries, 
including videos and other resources, and offering real meeting points for discussing and possibly video 
recording arguments and controversies. However, it should not be forgotten that also the classical structure 
of papers itself can be significantly improved. For example, authors should be requested to formulate in 
special (sub) sections as precisely as possible 

1. the research question (puzzle, challenge, "mystery") addressed, 

2. the research methodology /approach, 

3. the underlying assumptions, 

4. the current evidence, 

5. implications or predictions allowing to assess the explanatory power, 

6. the expected range of validity or limitations of the approach. 

2.2.6 Editorial board 

Editorial boards have a fundamental role in stimulating high-level scientific exchange. They should be 
composed of people who have had impact and earned international reputation already. In order to con- 
cretely define who is entitled to sit on a board, minimum scientific requirements should be formulated. For 
example, one may start with scientists who have published in leading journals and/or have had several 
publications with 100+ citations. Additional editorial board members may be elected by the editorial 
board, if this is necessary to fill gaps in the coverage of certain areas. In the long run, however, the edito- 
rial board would be composed of the scientists who reached the highest reputation points (see Sec. 12.2. 8|) . 
Finally, turnover policies should be implemented, which regularly exchange editorial board members in 
order to avoid their overload and to counteract the emergence of systematic biases in favor or against 
certain fields, approaches, or authors. 
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2.2.7 Rating 

Journal contributions would be rated on a multi-dimensional scale, based on criteria such as readability, 
importance, novelty, controversy, etc. Registered users could rate a contribution once and only once, and 
rectifications should be possible. Users would be endowed with a fixed amount of rating points per month. 

Regarding the actual rating widget, special solutions should be implemented that allow to visualize 
multiple dimensions at the same time. For example, ratings in different categories could be displayed in 
different customized ways, such as 

• bar diagrams with bars in different shapes and colors, 

• star diagrams, or 

• facial diagrams. 

Besides the colors, also their saturation and luminosity values would be varied. Initial ratings would be 
in light colors, but the rating symbols would become more intense, the more ratings are made, while a 
large variability of ratings would reduce the color intensity. 

Depending on their focus, each journal could select their own rating criteria and the weight they are 
giving to them. For example, they could weight certain dimensions like novelty or controversy more than 
others. 



2.2.8 Reputation system 

Besides journal contributions, also raters would be rated and evaluated. That is, authors, referees, and 
editors would earn a reputation, which would determine the weight they have in the determination of 
average ratings. Higher reputation would also imply certain user benefits (see Sec. I2.2.10|) . Therefore, 
raters should be concerned about their reputation. 
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Rep utation and reputation systems have been the object of scientific study already for some time [37 . 
U HI, 51 41, 42 1- For most collaboration systems, reputation and its management is the key point 
that decides over success or failure. Challenges to address include the identification of communities (i^ 
and of collusion or defaming [44[ (see Sec. 7 in [45[ for some related proposals). 

Reputation could be determined, for example, from the average ratings of the contributions of a 
rater. Unusual rating patterns (as compared to other users) would be identified by algorithms, to reveal 
possible misuse of personal reputation in rating activities. (In case of disagreements with general opinion 
trends, it would be appropriate to make a comment.) Attempts to manipulate the rating system would 
be sanctioned, e.g. by setting the weight to zero for some time. 



2.2.9 Recommender system 

Another challenge besides the design of a manipulation-resistant reputation system is the creation of a 



privacy- respecting recommender system. Both issues have been addressed in another White Paper [45 1. 

The Wcb2.0 science journal could offer their users to customize their own rating system. Consequently, 
they may create their own indices by setting personal weights determining the ranking of papers (e.g. 
they may overweight novelty or controversy). Of course, they would also specify their field of interest. 

The system would recommend contributions based on keywords, title and abstract (tagging concept), 
or based on correlations in download patterns (Amazon concept). Alternatively, a user may choose to 
get recommendations on author network analysis or citation analysis, or on recommendations of certain 
raters, or a surprise mechanism. Users may also be alerted when new manuscripts of interest (e.g. in 
certain subject areas or by specific authors) appear. The recommender system may also analyze the 
impact of papers or authors, or determine emerging fields. 
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2.2.10 Incentives 

So far, a number of journals have made experiments with several of the above features, but the success 
has been limited. The main reason seems to be that user participation in rating and commenting tends 
to be low. In order to change this, users need to have incentives to contribute. 

For example, the Web2.0 journal could foresee different kinds and levels of access to the publication, 
information and recommender system. Depending on the amount of user contributions and their quality 
(as determined by the rating system), users may have earlier or later access to newly published articles, 
or they may be able to use certain functions of the recommender system or not. 

The number of rating points per months could be coupled with the number and quality of contributions 
as well. Furthermore, the reputation of contributors would determine their weight as referees. Contributors 
with high reputation would also qualify for bottom- up review (see Sec. I2.2."2| . 

Contributors with particularly high reputation would qualify themselves for the editorial board (see 
Sec. I2.2.6[) . To provide incentives to work as editorial board member, these may be allowed to select 
number (e.g. three) of their papers per year for the "best of selection" (see Sec. 12. 2.3]) . Furthermore, they 
may select ("sponsor") a limited number of papers of other authors for it. The other contributions in the 
printed "best of" volumes would be determined according to the ratings of the scientific community. 



3 ICT solutions to increase the awareness of new emerging 
trends 

Ideas and successful innovations often start off in a minority position (l6j , and they are hard to notice in 
an information-rich environment. They require targeted support in order to flourish. Therefore, suitable 
tools are needed to identify emerging fields, rising stars, and natural scientific alliances early on. 

IBM's shortsightedness in foreseeing the potential of personal computers is just one example for the 
difficulty to determine the potential of innovations. It is well reflected by the famous 1943 quote by 
Thomas J. Watson (Chairman of the Board of International Business Machines - IBM): "I think there 
is a world market for about five computers." Even more sensational was Xerox's donation of the mouse 
concept as we know it today to Apple during a visit of Steve Jobs to the Xerox PARC research center. 
This was 1979, and as it is well-known that it significantly contributed to the great success of Apple 
computers. Also, the widespread use of text messaging on mobile phones was not at all anticipated. 

Fortunately, these technologies eventually found their way, but many potentially useful innovations 
never did, and this is true for both industry and science. We therefore need tools to systematically discover 
the most innovative ideas. 



3.1 Classical scientific impact analysis 

In the landmark contribution "On the electrodynamics of moving bodies" , in which Albert Einstein 
elaborated his theory of special relativity in 1905, readers will be surprised to find no references to other 
scientific publications. Today, the number of citations is often considered to be the gold standard for 
rating a scientists' value. 

Knowing of the benefits and limitations of citation analyses, there are a number of different indices 
that try to identify good scientific contributions, authors, and journals, as is reflected by the following 



incomplete list [46|, |47J, |4 



• Hirsch's /i-index. The most famous index for measuring scientists quality is named after its 
inventor Jorge Hirsch [49l |. It is defined as the maximum integer n such that there are n papers 
which received at least n citations each. 
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Egghe's g-index Proposed by Leo Egghe [50(, it aims to improve on the ft,- index by giving more 
weight to highly-cited articles. It is defined as follows: Given a set of articles ranked in decreasing 
order of the number of citations received, the g-indcx is the largest number such that the top g 
articles received on average at least g citations. 

Zhang's e-index 

The e-index as proposed by Chun-Ting Zhang (5ll | tries to differentiate between scientists with 
similar ft-indices, but different citation patterns. It is the square root of the surplus of citations in 
the h-set beyond the theoretical minimum required to obtain an /i-index of h. 

Contemporary /i-index 



Proposed by Antonis Sidiropoulos, Dimitrios Katsaros, and Yannis Manolopoulos 52J, it aims to im- 
prove the ft-index by putting more weight on recent articles, thus rewarding scientists who maintain 
a steady level of activity. 

Age-weighted citation rate (AWCR) and AW-index. 

The AWCR [f33| measures the average number of citations to an entire body of work, adjusted for 
the age of each individual paper. 

Individual h-'mdex 

Proposed by Pablo D. Batista, Monica G. Campiteli and O. Kinouchi [H^, it compares researchers 
with different scientific interests. It divides the standard /i-index by the average number of authors 
in the articles that contribute to the /i-index, in order to correct for the beneficial effects of co- 
authorship. 

Multi-authored ft-index 

A multi-authored version of the ft-index by M. Schreiber [55^ uses fractional paper counts instead 
of reduced citation counts to consider the shared authorship of papers. It determines the multi- 
authored h m index based on the resulting effective rank of the papers, using undiluted citation 
counts. 

/ib-index and m-number. 

The hb-mdex [Hit has been developed as another extension of the ft-indcx. It applies to scientific 
topics instead of to individual scientists. Assuming that hb increases linearly with the number of 
years n from the first published paper in a given topic, the hb index can be defined as h(, = nm, 
where m is the gradient, which varies from topic to topic. Large values of m and hb denote hot-topics. 

Journal Impact Factor (JIF) 

The Journal Impact Factor has been invented by Eugene Garfield in 1975 [131 ■ It is a proxy for the 
relative importance of a journal within its field. Given a reference year, say 2009, it is defined as 
the total number of citations received in 2009 by papers published in the journal in the previous 2 
years, divided by the number of these papers. The journal impact factors are calculated yearly for 
those journals that are indexed in Thomson Router's Journal Citation Reports. 

Immediacy index 

It reflects the average number of citations that articles in a given journal receive during the year 
they are published. It is part of the yearly Journal Citation Report, calculated by ISI [58(. 
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• Cited half-life 

The Cited Half-life is the median age of articles that were cited in the Journal Citation Reports each 
year. For example, if a journal's half-life in 2005 is 5, it means that the citations from 2001-2005 
are half of all the citations of that journal in 2005. The other half of the citations precede 2001. 

• Aggregate impact factor 

The aggregate impact factor is determined from the number of citations of all journals in a subject 
category and the number of articles in all journals belonging to that subject category. 

• Eigenfactor™ Score 

The Eigenfactor Score calculation is based on the number of times articles from the journal published 
in the past five years have been cited in the Journal Citations Report year. It also takes into account 
the impact factors of journals and eliminates the effects of journal self-citation. 

• Article Influence™ Score 

The Article Influence shows the average influence of a journal's articles over the first five years after 
publication. It is calculated by dividing a journals Eigenfactor Score by the number of articles in 
the journal, normalized as a fraction of all articles in all publications. 

• Co-citation index 

Two documents are said to be co-cited if they appear simultaneously in the reference list of a third 
document. The co-citation frequency is defined as the frequency with which two documents are 
cited together. The co-citation index has been first proposed by Henry Small [Hi^ . 

3.2 New indices to discover innovations 

The indices mentioned in the previous section can certainly be helpful to determine promising scientific 
contributions, but they also have a number of weaknesses. For example, they are not rewarding scientific 
contributions that are not separately cited (such as data sets or computer animations or many of the 
contributions called for in Sec. I2.2.5p . Moreover, scientific impact is still largely measured in a journal- 
centric way, while it should be measured directly where it matters, i.e. on the articles level Therefore, 
in an attempt to extend classical bibiometric measures, a new discipline called Scientometrics 2.0 is 
trying to mine Web 2.0 sources, such as clickstreams [6l(, downloads, news, tweets, Diggs and blog 
entries, looking for signals of scholarly impact [f|2]. Citations in traditional journals may take years 
to accumulate jT^i while on the Web the community response can be measured almost immediately. 
Successful further steps in this direction could permit to create a quasi-real-time monitoring of cutting- 
edge scientific innovation across disciplines. 

Another dissatisfactory point of the current way of measuring impact is the circumstance that the 
number of citations does not reflect the relative scientific importance of a contribution well, as some fields 
are small and others are large. One consequence of the orientation at citation rates is, therefore, that 
scientists are pulled into highly cited fields. Such herding effects cause that people turn their attention 
away from other important research fields, particularly from difficult ones with low publication and 
citation rates. 

One would therefore need to have indices allowing one to compare contributions and scientists from 
different disciplines, and to judge multi-disciplinary publications in a fair way. A first step in this direction 
has been recently made [63[: The hf -index proposed by Radicchi, Fortunato and Castcllano aims at 
reducing the strong field dependence of the /i-index due to different sizes of scientific fields and their 
heterogeneous publication rates. It is computed like the /i-index, but after scaling both the number of 
citations and the rank of the papers by suitable constants depending on the discipline. Unfortunately, 
these constants are currently not available for all fields. 
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In addition, it would be important to compare the potential of contributions by junior scientists 
with those by senior scientists. Consequently, suitable indices will have to be developed for this. Recent 
analyses give hints how this could be done jig ). 

A further relevant question is, how to translate performances measured on multiple scales into one 
single indicator (i.e. a rank). This is traditionally done by weighting each criterion with a certain factor. 
Such an approach, however, promotes average performance rather than excellence, as the latter is typically 
characterized by extreme values on one or a few rating scales, but not in all of them. In order to give 
everyone a fair chance and to reward excellence in specific areas, one needs to introduce new metrics 
capable of spotting out individual talents. Appendix |A1 suggests two promising ways of doing this. 

Finally, it seems to be advisable to complement citation analysis with reputation analysis, as outlined 
in Sec. 12.2.81 and in Ref. (45[. In order to determine the potential of innovations, it is also necessary to 
separate the effects of institutional settings (such as better equipment or better networking, which can 
largely accelerate the dissemination of scientific work) from the quality of contributions (which reflect 
individual talent). Spotting the right talents and the right institutions is quite important. Moreover, it 
would be dcsircablc to quantify conditions of scientific success, such as a multi-disciplinary collaboration 



culture. Questions like these are recently being addressed by research fields like Scicntometrics |64l. I65j ■ 
or, more recently, Science of Science 66, 63|- Both fields are largely overlapping, but the latter focuses 
more on the financial, social, geographical and institutional factors contributing to scientific success. 



4 Tools to enhance Europe's innovation potential 

4.1 Why and how to free up scientists' time for research 

A recent Europe-wide initiative, called Trust Researchers [68| has pointed out an urgent need to reduce 
the administrative overload of scientists and find better ways to fund research. In fact, great scientific 
talent is extremely rare, and consuming time of these talents for anything else than science is an extreme 
waste of resources. It causes that less high-level research can be performed, a problem that can only partly 
be compensated for by employing additional (less talented) scientists. Consequently, it is imperative to 
protect scientists from overusing their most precious and scarce resource, which is time. 

In spite of this, over the last decades, scientist found less and less time for research, as they had 
to pay more attention to teaching, to a growing number of students (with, consequently, less talent on 
average), on grant applications, managing projects, preparing reports, presenting at project meetings, on 
public dissemination through the media, etc. This large variety of activities is extremely distracting and 
makes it impossible to concentrate on one task over extended time periods, as it is typically required for 
breakthroughs. However, fractionalization of time into small pieces is just one problem. A fact known 
from logistics is that it takes a massively longer time to complete tasks, when one operates too close to 
maximum capacity (time reserves) , and most scientists already work much longer than the time they are 
paid for (often 60 hours per week or more). 

The fact that scientists are performing many additional tasks without extra payment (typically) has 
caused a "tragedy of the commons" (69| in the scientific system. While evaluations were focused originally 
on evaluations for tenure and search committees, they are now made for a steadily growing number of 
papers and project proposals, for students, even for conference applications. This cancerous spreading of 
evaluation load is a serious waste of resources. While the classical idea of Humboldt's university concept 
foresees 50% research and 50% teaching, administrative loads can easily exceed 80% today. Estimates 
regarding the time spent in EU projects on administrative tasks (including proposal writing, coordination, 
meetings, reporting, evaluation, financial accounting, presentation, dissemination) reach from 40% to 
75%. It is obvious that tax payers' money could be used more efficiently, if better funding schemes were 
available. 

Given the scientific performance indices that are available today or under development, one could move 
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from funding of promised research results (proposals) towards refunding for research results obtained. 
Scientists would then focus on research and the publication of their results. Proposals, intermediate and 
final reports would not be necessary anymore. Instead, publications would be evaluated. This would 
free up time for research and publications, which are anyway subject to a quality evaluation process. 
In fact, Universities in the Netherlands and in China, for example, grant money for publications. This 
funding principle could be largely extended (see the paragraph on "incentive-based crowd sourcing" in the 
next section |4.2[) . Research proposals would then only be needed for special investments (e.g. expensive 
laboratories) which cannot be covered by overheads. 

However, scientists are not only burdened by administrative and managerial tasks. Finding relevant 
information for their studies becomes a more and more inefficient process due to the world information 
overload that is sometimes called "data deluge" [45[. For example, in 2008 there were about 47,000 papers 
and more than 350,000 datascts containing useful information about the p53 protein which regulates the 
cell cycle and that could prevent the development of cancer [7(J. This means that, at present, there is no 
way for a single human being to browse through and get all the possible knowledge out of such a vast 
literature. Yet the problem of finding a definitive cure for cancer remains open. 

In other words, researchers must waste a considerable amount of their time in mining vast scientific 
corpora with inefficient techniques, looking for the most significant contributions. Obviously, finding 
related work in complementary disciplines is even harder. Therefore, scientists need the support of specific 
searching, archiving, sharing and discovery tools. Conditions should be provided, in which they can devote 
as much of their time as possible to the creation of quality. The "Innovation Accelerator" or "Knowledge 
Accelerator" sketched in the following, could create such conditions. 

The Innovation Accelerator is an integrated ICT-based platform aimed at fostering the creation and 
sharing of scientific excellence by reducing all unnecessary friction of today's scientific knowledge pro- 
duction and dissemination. It will help business people, politicians and scientists to find the best experts 
for a project, ease the communication in large-scale projects and support their flexible coordination, co- 
creation, and quality assessment. New trends will be discovered earlier on, allowing the investment into 
emerging trends and technologies. 

The Innovation Accelerator requires the provision of new tools to 

• support a community-specific definition of scientific quality, 

• easily setup and manage large-scale scientific collaborations, 

• allow efficient scientific co-creation, 

• allow efficient many-to-many communication, 

• promote schemes for a fair distribution of public funding based on scientific merits. 
The innovation accelerator is expected to trigger many positive externalities, e.g. 

• to increase interactions among scientists, 

• to stimulate scientific debates, 

• to promote the exchange between different scientific communities, 

• to provide better chances for scientific innovations and heterodox research approaches, 

• to support all steps in the scientific production process. 

Some of the principles that will be required to make such a system work are a balance of power (sym- 
metry), transparency, feedback, sanctioning of misuse, and ownership of, responsibility for and control 
of results of creative activity. In the next section we will describe how such a Web 2.0-likc, distributed 
platform could look like, and what features it should have. 
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4.2 How to create an Innovation Accelerator (IA) 

Quite recently, it has been impressively demonstrated how powerful massive collaboration can be used to 



solve complex problems, for example, in mathematics [71]. The Innovation Accelerator (IA) is envisioned 
to be a tool to support such large-scale creative collaborations. It can be imagined as a distributed 
internet-based platform, implementing the trinity of zero-install, ubiquitous access and rich and intuitive 
UI (User Interface) [z3]. 

The IA framework could be realized through the use of standardized building blocks that are explicitly 
created to communicate with a large information network infrastructure, acting as backbone for sharing 
data across multiple communities. Each building block would represent an independent entity, offering a 
well-defined service hidden behind a standard interface. Finally, an intuitive administration panel would 
permit each community to create a customized IA tailored to their needs, combining the desired blocks 
in a simple-to-use, but powerful tool. 

In order to promote innovation rather than obstructing it, the use of the IA should be free or at least 
affordable for academic institutions all over Europe. For example, the IA architecture could be open- 
source in order to reach the openness and dynamics ensuring that it is well functioning and widely used. 
The IA architecture would include the following modules: 

• A forward-looking resource manager optimizing the use of resources (money, space, staff, 
etc.). For example, it should be able to suggest different options how project money at an institute 
(potentially coming from different funding sources with different spending restrictions) would be 
best spent, considering plans and constraints. 

• A project and team calendar would support a coordinated project schedule and send reminders 
or alerts, when appropriate. 

• An intelligent career manager would try to match job openings and the best experts on a 
European scale. For example, required competencies could be searched against a tag database or 
against similarity scores in recent publications. 

Interested researchers would create a list of institutions where they would like to work, and they 
would be automatically notified of the next available positions. On the other hand, institutions 
could tune the number of desired applications by requiring to pass a certain reputation barrier or 
test before applying. 

The same system could determine an appropriate salary range, based on the respective set of skills, 
publications, and other factors. 

• A social networking module would provide standardized building blocks for the creation of 
project websites and discussion groups (e.g. workpackage-specific ones). It will offer standard inter- 
faces to organize and combine the other components of the IA in a fully customized way. 

Clicking on names (or pictures) of the mutually entangled social networks would bring up their most 
recent contact information, and to alleviate personal contacts, would indicate at which conferences 
one could meet the person (given his or her permission) . One could also directly e-mail or skype the 
person or would get an information when the person is reachable (given this information is made 
visible). 

• A many-to-many communication system will allow one to manage complex messaging patterns 
within a simple and intuitive interface. For example, users will be able to activate specific (e.g. 
workpackagc-rclatcd) mailing groups within a few clicks, tuning parameters such as adding or 
removing members, enabling or disabling the reply-all function, blind-carbon copies, hiding the 
email addresses of recipients, but showing their names, etc. It should manage groups easily via 
the social networking module and automatically resolve address duplication and address updating 
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issues. The messaging should support the inclusion of crowd sourcing widgets such as polls, doodles 
and maps. 

Additional security and reliability protocols could be enabled directly from the same interface, and 
encryption and/or digital signatures of messages should be easily possible. Other procedures such 
as public key retrieval, handshake phases, etc. should be automatically handled by the system. 

Sanctioning mechanisms against spammers and other abusers should also be implemented. 

A virtual conference module would allow one to set up Web seminars ("webinars") or Second- 
Life-like environments for virtual group meetings, thereby reducing the need for travelling. Mecha- 
nisms for moderating, assigning turns, and reserving the next speech should permit every participant 
to express opinions in an orderly fashion. 

Participants of the virtual meeting would be supported by a series of virtual gadget. For example, 
electronic documents such as articles, images, videos or maps should be easily and immediately 
accessible. Moreover, virtual dashboards would capture in real-time all relevant information of the 
meeting, store it in an encrypted hie and send out a link and decryption information to authorized 
recipients who want to have access to the recordings. 

An incentive-based crowd sourcing system would collect ideas how to address the most impor- 
tant scientific challenges. These would previously be elaborated at "Hubert workshops", at which 
scientists gather not to present their results to each other, as usual, but to identify open problems. 
The resulting set of questions would be published on-line, and there would prizes to reward the best 
solutions. Prizes could be diverse, ranging from a "medal" or monetary prize up to research grants 
or academic positions. The selection and formulation of the grand challenges should make sure 
that practically relevant, goal-driven, and multi-disciplinary research would be particularly stimu- 
lated. Such an approach has been very successfully applied by Innocentive [t3] or in the DARPA's 



balloon-finding challenge [741 ]. It is also being used in certain software development communities, 
for example in discovering and documenting bugs in new releases of Internet browsers (75| . A com- 
prehensive collection of prizes issued to stimulate innovation can be found in Ref . [76| . Of course, 
less fundamental challenges could be posted in separate subject- or community-based user forums 
and worked out in a similar way, according to customized settings. 

A public dashboard will allow people to announce the current subject of their study. This serves 
to stimulate collaborations and to avoid too much multiplicity in attacking scientific challenges. 
For example, scientists working on a certain challenge will be displayed next to it, and additional 
information such as the solution approach may be announced as well. They could also look for 
partners with competencies they are lacking themselves (see the "intelligent career manager" , the 
"information discovery and retrieval system" and the "reputation system" for details). Ideally, the 
system should foster both collaboration and competition to the right extent ("coopetition"). 

A decentralized co-creation system would allow researchers from all over the world to actively 
and efficiently take part in large-scale projects. Commonly produced documents would be stored 
within a versioning system which would keep track of all the changes and highlight them, with the 
possibility to easily revert or merge them by semi-automatically resolving conflicts between diverged 
versions. 

Ideally, project participants would be able to work on different parts of the document in parallel. 
Mechanisms to assign or reserve portions of the document for a given amount of time to certain 
editors should be implemented (through suitable access right management). Moreover, the system 
should automatically invite people to work on certain parts, and it should highlight who is currently 
editing them. 

Document versions and their sections and paragraphs could be rated 
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(i) by the authors themselves, 

(ii) by invited reviewers or 

(iii) by public audience (according to what has been decided by the authors). 
Different roles for commenting and rating could be easily implemented here. 

When the quality of the ratings reaches a certain level, which means that the majority of authors 
has found an agreement, that part or version of the document is frozen and eventually submitted 
for publication. Authors could continue working on other parts or on new versions of the document. 

The system would record the activity of each author, and should be able to visualize their contribu- 
tions in the joint document. Author contributions may also be summarized in words or by statistics 
at the end of the document. This would help to clearly identify who did what, which can usually 
only be guessed from the order of authors names (a situation that is particularly dissatisfactory 
when a publication is co-authored by many scientists). In fact, journals like Nature and Science 
have started to explicitly state Author Contributions. 

• A quick annotation system would store and retrieve important notes for the future, and it would 
allow one to easily import ("pull in") graphics, statistics, Web links, videos, scientific references, 
and other relevant information. 

• A semi-automated reporting system should take care of reporting duties. This requires that the 
information (about publications, projects, and presentations, etc.) would be standardized, search- 
able through a single tool, and entered only once, while the resulting output could be formatted 
automatically in individually customized ways (such as a publication list, for example, or a CV, or 
annual report). 

• An information discovery and retrieval system would consist of a rich user interface allowing 
to easily and simultaneously query multiple databases and archives. When searching information, 
people could choose between different options. Information of interest would be determined based 
on information such as time- window of generation, author namejl tags (key words), ratings, author 
reputation, number of comments, number of downloads, etc. (sec Sec. I2.2.9j) . Advanced search 
criteria could be: user-defined compound indices, correlations in download patterns, author network 
analyses, citation analyses, direct recommendations of other users, or a surprise mechanism. Users 
could choose among the above-mentioned search criteria or combine them in order to find the one 
fitting their needs best. 

Moreover, comfortable tools for information navigation and the visual browsing of query results 
would be available. Finally, users may choose to be alerted of new information of the kind they 
like. Further statistical evaluations could provide a trend analysis, identify new users or subjects, 
emerging fields, and collaboration clusters. 

• A networked knowledge manager would be in charge of linking together and updating all pieces 
of relevant information that were already discovered. References and citations of a scientific paper 
should be immediately accessible. Figures and underlying empirical data could be made directly 
downloadable, while memorizing (and displaying) the original source. 

• A shared context-aware reputation system would implement mechanisms to store, exchange, 
modify, convert and share reputation points within decentralized communities. Reputation would 
result from the evaluation of citations and a rating system (see Sees. 12.2.71 12.2.8| 13.11 and I3.2[) . 
Compared to current systems, raters would be rated as well, and their weight would depend on 
their own reputation. Moreover, reputation would be measured on multiple scales, allowing one to 



2 Advanced name disambiguation algorithms would be automatically invoked whenever required. 
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distinguish, for example, people who have many good ideas on different subjects from disciplinary 
specialists who can elaborate a difficult theory, experimental scientists, or people who can write 
good reviews or criticize others' work in a fruitful way. Fairness would be rated as well, and content 
would be classified into information (that can be substantiated), opinions, and further categories. 
The novelty of the information would be easily visible, as well as the frequency and homogeneity of 
user responses in the different categories. There would be non-anonymous and anonymous kinds of 
ratings and information, but they would be separately evaluated and clearly marked. Attempts to 
manipulate the ratings would be sanctioned by reducing the reputation values. 

When rating on multiple scales and recording the identity codes of raters (in case of non-anonymous 
votes), reputation could be evaluated in an individualized way. Therefore, the reputation of some 
information or of the person who generated it could vary from one user community to another, 
depending on their customized settings. In this way, communities could develop their own quality 
standards. 

• An integrated micro-credit system to provide incentive schemes that reward scientists for 
their personal contributions. Credits could be earned by certain activities (e.g. rating, reviewing, 
commenting, etc.), and they would be lost in case of vandalism, lack of participation, or spamming 
etc. 

The virtual credits would be primarily spent within the IA system. For example, recipients of e- 
mails could set a price for spending their time on them, which may depend on how busy they are, or 
on the categories of the persons or companies contacting them. Such micropaymcnts should make 
sure that time budgets of scientists will be better used. 

The micro-credit system is also important to reward people for participating in crowd sourcing 
activities (mentioned before). It would therefore be good to foresee mechanisms which would allow 
one to convert virtual money raised by this microcredit system into travel grants or project funding, 
for example. Micro-credits could also be used to obtain premier information services from the 
information discovery and retrieval system (see Sec. 12.2.91) . 

• A virtual education module should support interactive scientific presentations from home with- 
out setup or travel times. Presentations would be recorded and could be played at any convenient 
time, allowing one to download related materials, make notes or comments, or ask questions. Notes 
would be easily searchable and related to each other via tags which would be extracted by the 
system automatically, while users could add further tags. Furthermore, notes could be easily shared 
with selected friends or colleagues. Besides lectures, scientists would use podcasts to explain their 
research. 

Eventually, lectures could more and more become like serious, interactive computer games, in which 
students would interactively explore virtual physical, biological, chemical or sociological worlds. The 
next level in these games would be reached, if enough understanding and reputation points have 
been collected. Such educational games could stimulate the imagination, ambition, and learning of 
students and the interested public. 

• Finally, a privacy settings panel should offer an intuitive interface to regulate and specify at 
a fine-grained level of detail, what data to share with whom, how, for how long, and under what 
conditions (see [45[ for more details). 
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5 New strategies to support a sustainable technological devel- 
opment 

5.1 Rating Systems and eGovernance 

The general principle of individualized services using a community-based quality evaluation, where not 
only objects are rated, but raters are rated as well (defining their "reputation" and influence/ weight), 
can be transferred to other application areas. Examples would be new evaluation procedures for project 
proposals, policies, or public and private services (including the administrative, transport, and health 
sectors). These issues will be discussed in more detail in the following. 

In particular, rating and reputation systems could be used to support a sustainable technological 
development. If the dimensions of the rating scales are properly chosen, an eGovernance system results. 
eGovernance can promote positive externalities in several areas, from politics, to business and science. 
The implementation of eGovernance solutions requires interfaces to set up opinion polls on a variety of 
subjects in an easy way. Standpoints of different stakeholders would be marked accordingly, and attempts 
to purposely cheat the system would be sanctioned. Fine-grained, semi-instant and automated polls could 
allow policy-makers to identify people's current factual and normative projections of the world, i.e. what 
they are expecting for the future and how they would like it to be. Obviously, participation in such polling 
activities would be voluntary. It could be coupled to the right to vote and viewed as materialization of it. 

eGovernance opens up many new opportunities. Politicians could get quick feedback on a certain issue 
from a large number of people in order to 

• get to know their preferences among certain alternative solutions, 

• get feedback during the implementation of decisions taken, and 

• evaluate long-term effects and the degree of satisfaction, even years after a policy measure has been 
implemented. 



5.2 Towards indices of human well-being 

The rating and reputation approach could, in particular, help to replace the gross national product (GDP) 
by better indices oriented at human well-being and sustainability, which have been hard to implement in 
the past due to difficulties in measuring these. Classically, increasing the gross national product (GDP) 
has had a great importance in political agendas in the past decades. However, it becomes more and more 
visible that increasing economic output alone is not sustainable. Therefore, scientists think about better 
indices to measure human development already for some time. The most prominent document in this 



connection is probably the manifesto on "Measuring Economic Performance and Social Progress" [77 



The author list of this report includes several Nobel prize winners such as Joseph Stiglitz, Armatya Sen, 



Kenneth Arrow, and Daniel Kahncmann. Here are some excerpts from a summary of it [78 1. 

"The seemingly bright growth performance of the world economy between 2004 and 2007 may have 
been achieved at the expense of future growth. It is also clear that some of the performance was a 'mirage', 
profits that were based on prices that had been inflated by a bubble. 

The whole Commission is convinced that the crisis is teaching us a very important lesson: those 
attempting to guide the economy and our societies are like pilots trying to steering a course without a 
reliable compass. The decisions they (and we as individual citizens) make depend on what we measure, 
how good our measurements are and how well our measures are understood. We are almost blind when 
the metrics on which action is based are ill-designed or when they are not well understood. For many 
purposes, we need better metrics. ... the time is ripe for our measurement system to shift emphasis from 
measuring economic production to measuring people's well-being. ... To define what well-being means, 
a multidimensional definition has to be used. Based on academic research and a number of concrete 
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initiatives developed around the world, the Commission has identified the following key dimensions that 
should be taken into account. At least in principle, these dimensions should be considered simultaneously: 

i. Material living standards (income, consumption and wealth); 

ii. Health; 

iii. Education; 

iv. Personal activities including work; 

v. Political voice and governance; 

vi. Social connections and relationships; 

vii. Environment (present and future conditions); 

viii. Insecurity, of an economic as well as a physical nature. 

All these dimensions shape people's well-being, and yet many of them arc missed by conventional 
income measures. Steps should be taken to improve measures of people's health, education, personal 
activities and environmental conditions. In particular, substantial effort should be devoted to developing 
and implementing robust, reliable measures of social connections, political voice, and insecurity that can 
be shown to predict life satisfaction. Statistical offices should incorporate questions to capture people's 
life evaluations, hedonic experiences and priorities in their own surveys." For this, the above proposed 
rating system could be very useful. 



5.3 The economics of happiness 

It is remarkable that many of the above mentioned dimensions correlate very well with "happiness" . 
While economic research has paid attention to it only recently [79j |. happiness indeed plays a prominent 
role in the American Declaration of Independence on July 4, 1776. The second paragraph starts with 
the statement: "We hold these truths to be self-evident, that all men are created equal, that they are 
endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the 
pursuit of Happiness." 

Happiness as a concept and goal of life is being rediscovered, recently. For example, a study of Deutsche 
Bank Research [§(J reached the following conclusions: 



Germany as one of best ranked countries in the GDP statistics has a less happy population as 
compared to many other countries ranked far behind Germany. 

Happy societies tend to be characterized by a high level of trust, a low level of corruption, a low level 
of unemployment, a late retirement, a small shadow economy, a high education, many freedoms, a 
high income, and more children. 

In other words, happy societies seem to be more sustainable in the long run. Based on suitable rating 
scales, the rating system of the Innovation Accelerator could be used to measure the relevant dimensions 



of happiness, which certainly entail, but at the same time go beyond, monetary reward [81l . |82|. The 
outcomes of such measurements could be used to orient policy- makers, i.e. give them a better compass 
than GDP was@ 

3 It is worth noting that, recently, a "Bank of Happiness" [83l | has been established, where people can trade good deeds 
instead of companies' stocks. Other initiatives point into the same direction [doogood]. 
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5.4 New incentive systems 

One important component in the creation of a more sustainable economics could be the creation of new 
incentive systems which go beyond sheer profit maximization. In fact, it is well-known that individuals 



respond to non- monetary incentives as well [79l l84l |85| , such as prizes or medals or just compliments 



The current science system is, in fact, a very good illustration of this principle. Authors spend a lot of 
time — and spare time — on creating manuscripts which they usually publish without taking money for 
this. In the same way, they participate in review, dissemination and administration activities without 
monetary compensation. One of the main motivations for this seems to be the reputation that they can 
gain among their peers (their colleagues). The existence of ranking scales (such as citation scales) is often 
enough to stimulate their ambition. Therefore, other ranking scales, something like area-specific "hit 
parades" , could probably create suitable incentives to engage in voluntary, socially beneficial activities 
in various areas of society and economy. Multi-dimensional reputation scales (see Sec. 12.2. 8|) could serve 
this purpose. For example, it is well known from computer games (and multi-player online games) that 
individual points or rankings on competitive scales can be very efficient incentives for people, stimulating 
their ambition and making them invest a lot of time. 

6 New ways to reach societal benefits and respond to industrial 
needs using ICT 

Quite obviously, individualized services using a community-based quality evaluation, where not only ob- 
jects are rated, but raters are rated as well, can be also used to assess product quality, to rate architectural 
designs, or to support the decision-making in companies. This only requires a suitable choice of the rat- 
ing scales (the price, the quality of ingredients, durability, production conditions, environmental impact, 
etc.). Rating and information services could also be based on mobile phones and WLAN architectures, 
e.g. when consumers buy products in a shop and want to have product information or want to rate 
products. 

Such technologies would allow companies to produce goods which come closer to their clients' dreams. 
This apparently requires to systematically analyze and consider meaningful customer opinions (e.g. wish 
lists) in the design of all stages of the product life cycle. However, not only could companies scale and 
speed up their early R&D activities dramatically by using crowd sourcing and other tools offered by the 
Innovation Accelerator. The feedback loops created by its rating systems would make it possible as well 
to realize the vision of participating consumers, or even consumers contributing to the production process 
(so-called "prosumers" [jil]). 

It is certainly not our task here to define the policies and technologies which serve the purpose of 
supporting economic progress best, while promoting social well-being and a sustainable environment. We 
believe that there is no simple and unique answer to this question. Nonetheless, there is a responsibility 
to prepare adequate tools to put future policy-makers into the position to take decisions based on the 
best available knowledge. "The world is filled with minds that can contribute. And when the information 



is shared, we can just move faster" [87 



7 Summary and final considerations 

The "Lisbon agenda" aims at creating a knowledge-based economy in Europe driven by innovation. In 
order to achieve this, it is necessary to re- invent innovation, in particular the way how science is performed 
at academic institutions. It is apparent that 

• the evaluation system does not work well anymore — it has passed its optimum and becomes more 
and more a burden, 
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• a new funding system is needed, which could be based on rewarding previous performance, 

• for this, one needs to develop multi-dimensional and fairer performance measures, as current indices 
are too biased and unfair, 

• new publication, communication, coordination, and co-creation concepts are needed to optimize the 
innovation rate and the dissemination of the best ideas. 

While various activities in this direction have started, there is still a long way to go. However, the benefits 
of novel ICT-based systems are expected to be large not only for science, but also for societies and 
economies. For example, multi- factorial reputation and recommender systems could connect producers 
and consumer communities more closely with each other, simplifying everything from crowd sourcing and 
prediction markets over customized services and personalized education to participatory production and 
consumption. 

The need for an Innovation Accelerator becomes particularly obvious when analyzing some institu- 
tional obstacles in the socio-economic and other research fields that the financial crisis has revealed. 
Despite its inherent logic, the current economic crisis and its course of events has not been well antic- 
ipated (cheap credits, US real estate bubble, quant meltdown, default of Lehmann Brothers, liquidity 
crisis, bank bankruptcy cascade, defaults of companies, mass unemployment, public spending deficits, 
instability of European currency, public saving plans, ...). This suggests that current mainstream theories 
do not describe such phenomena well enough. Considering that economic crises implies a loss of property 
and security for many people and potentially serious impacts on their lives, it seems required to think 
about beneficial institutional changes. 



7.1 The education system 

Some of the institutional problems that need to be overcome concern the education system. In many 
scientific fields, including various socio-economic sciences, academic curricula seem to lag considerably 
behind the scientific state-of-the-art. For example, in economics, rather than promoting principles like 
sustainability and fairness, economics still confronts students predominantly with a world view of profit 
maximization, while scientists have revealed since a long time that humans responds to other, non- 



monetary incentives as well [79l . l84l .l85l]. and that monetary incentives can damage voluntary commitments 
[88j |. This biased educational approach results from the leading paradigm of the "homo economicus", i.e. 
of the "perfect egoist" , which is promoted by most economics text books and many research articles 
despite of contradicting evidence (see Ref. [89( for a more detailed discussion of this point). It is quite 
interesting to ask why the discoveries of Nobel prize winners in economics, like Kahnemann and Tversky, 
Scltcn, Schclling, Akcrlof, Stiglitz, Krugmann, or Ostrom, to give just a few examples, have not managed 
to change this paradigm over the decades. Most likely, this is a consequence of the difficulty to obtain 
suitable data to test socio-economic theories in the past. However, university courses also need to change in 
other respects. They should be significantly adapted, considering the revolution in the area of information 
technology that the world has seen and the significant progress in areas such as complex systems modeling 
and computer simulation, or data mining. 



7.2 The recruitment system and incentive structures 

One of the central question is why we do not see a larger degree of innovation and change as compared 
to other fields. In physics, for example, classical mechanics was replaced by quantum mechanics and rel- 
ativistic mechanics. Moreover, it has been complemented by electrodynamics, statistical mechanics, and 
a varity of other fields. New, interdisciplinary fields like bio-, traffic-, econo- or socio-physics have been 
created. In the past few decades, there have been a number of new research focuses such as superconduc- 
tivity, nanoscience, spin glasses, neural networks, chaos theory, or network science. It appears that not 
all scientific fields have the same innovation dynamics. 
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One of the underlying problems may be the prevalent recruiting system. In order to become professor 
of economics, one must have published in the leading peer-reviewed journals of economics. The number 
of these A-rated journals is relatively small, and the number of articles is limited. The selection of papers 
that arc finally published in these journals is carried out by a relatively small number of people who 
are following more or less the same economic paradigm(s). This creates similar problems as known from 
oligopolcs. Not only can an "old boys club" control the market of publications by the way, in which 
manuscripts are selected. Ambitious junior scientists also have to subject their research subject and 
research approach to the preferences of these journals, otherwise they are punished with the "academic 
death penalty" of being chance-less in the competition for chairs in economics. 

7.3 The publication system 

Many scientists are complaining about their journals: 

1. for the long publication delays (in some fields, the publication of scientific manuscripts in case of 
acceptance typically takes 2 or 3 years as compared to 4 to 6 months in physics or biology, and it 
takes even longer in case of rejection), 

2. for the narrow selection of manuscripts and the little freedom to come up with innovative ideas 
(quality control also introduces a certain degree of "censorship" into the scientific system, in contrast 
to the way the public media work). 

The level of pluralism seems to be largely dependent on the field. In microeconomics, for example, there 
is just one predominant approach, which is the paradigm of the "homo economicus" . In macroeconomics, 
there are just two, namely Keynesianism and neoclassical economics, and both of these are not fully 
supported empirically. Nevertheless, they are the prevailing approaches informing today's policies. 

For systems as complex as economies, a pluralistic modeling approach would certainly be more ap- 
propriate . Today, it appears that innovation is often slowed down by requiring that new results should 
be consistent with previous ones. Kuhn's work on scientific revolutions [H[ suggests that the evolution of 
knowledge is not gradual, but characterized by paradigm shifts. It appears, however, that such paradigm 
shifts have not happened in certain fields for a long time. 

A further obstacle to innovation seems to be the focus on purely analytical results. This restricts 
research mainly to relatively simple models. It is therefore hard to see what can happen in complex 
systems with strong non-linear interactions, random influences, spatio-temporal and network dynamics, 
and heterogeneity. We think that many of the remaining scientific challenges these days cannot be solved 
without the use of computers. The tools and instruments dominating in certain scientific fields do not 
appear to be fully sufficient to understand the complexity of the studied systems [§!| . While areas like 
physics and biology are using the most powerful computers to simulate their systems and turn data into 
knowledge by sophisticated data mining concepts, these methodologies have not spread into all scientific 
fields so far. It is almost as if we would not use all our senses to get a picture of the world. 

7.4 The research approach 

While the scientific problems to be solved are big, average research teams are very small. This promotes 
the specialization on details, while systemic studies, e.g. the study of systemic risks, are rare. In fact, 
certain fields seem to be pretty much fragmented. This situation seems largely due to a lack of 

1. methods from complexity science, 

2. computational modeling, 

3. empirical and experimental data, 
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4. engineering-like solutions and tested alternatives. 

In areas dominated by mathematical analysis, multi-disciplinary collaborations seem to be rare, al- 
though behavioral studies, statistical physics and complex systems theory, agent-based modeling, machine 
learning, artificial intelligence, systems design and advanced testing would be highly relevant to advance 
the knowledge and design in a number of fields involving human behavior. 

A problem that comes with a largely axiomatic approach (which can be quite successful, of course) is 
the lack of orientation at the real world (data and problems). Experimental and data mining approaches 
are coming up in some fields only recently, and suitable experimental and measurement procedures still 
need to be developed. Although difficult, it does not seem to be out of reach. Moreover, many analytical 
results are only achievable with approximations. Consequently, the quality of an approximation must be 
cither tested against a quasi-exact numerical solution or against experimental data sooner or later to 
identify the limitations of a model. Again, the collaboration with other disciplines should be fruitful here. 

7.5 The knowledge creation cycle 

One must be aware that the remaining puzzles concerning the behavior of complex systems can probably 
not be solved with the methods used in the past, but require the use of new approaches. When resulting 
from non-linear feedback effects, which are typical for networked systems with strong interactions, they 
often have counter-intuitive explanations. Most large real-life systems are of exactly of this kind. Such non- 
linear interactions often give rise to self-organization and emergent phenomena, i.e. the sudden appearance 
of new properties (innovations are typical ex amp les). As the system behavior is difficult to predict, control 
may be an illusionary concept (see Refs. [9(l[9l| for a detailed discussion). It is essential here to underline 
that self-organization and emergence cannot be understood with equilibrium or linear models. They 
require non-linear dynamical models, while many empirical studies use (multi-variate) linear models, i.e. 
statistical approaches that cannot reveal the non-linear laws underlying complex systems. 

Scientific progress requires a number of different steps, including non-linear data analysis, mathemat- 
ical modeling, computer simulation, and finally, optimization, management, control or systems design. 
Specialization often prevents researchers to be engaged in all steps of this scientific knowledge creation 
process. Therefore, working in larger, multi-disciplinary teams appears to be a necessary development, 
particularly when considering the long publication times at present. 

It must be underlined that scientific knowledge creation is neither a one-step process nor a linear 
progress, but is better imagined as a networked system with feedback loops. It seems natural, for exam- 
ple, to start of with simple models to explain certain stylized facts. As good data sets become available, 
e.g. through lab experiments, empirical analyses, or technological developments, models can be calibrated, 
tested, verified, falsified, or improved. Usually, the data analysis reveals new facts that require a conse- 
quent modification or extension of the model(s). Therefore, a plurality of alternative models can speed 
up the development of realistic models 0] ■ Some day, models become so good that they can reproduce 
the majority of observations. It becomes possible then to apply them to practical problems. 

Realistic challenges on the other hand call for specific types of models. For some questions, aggregate 
("macroscopic") models may be more adequate, for other questions, "microscopic" (e.g. agent-based 
approaches) may be more suitable. Moreover, overseeing the collection of stylized facts that the interaction 
between data analyses and computational predictions has revealed, it becomes possible to simplify realistic 
models in a way that allows an analytical understanding at the cost of quantitative accuracy. All these 
different approaches and steps are needed to make scientific progress. If the interaction between these steps 
is obstructed, scientific progress may be slow or impossible. For example, when requiring realistic models 
right away, or when narrowing down the number of models too much in an early stage of the development 
of a field, scientific progress will be hardly possible. Unfortunately, it seems that the interaction between 
different disciplines involved into the research process currently does not work very well in some scientific 
fields, i.e. there are missing links or at least weak ones, as compared to other scientific fields. This is not 
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only a problem of research traditions, but also an institutional problem, which needs to be addressed and 
can be overcome. 

7.6 Suggestions for institutional changes 

In the following, we suggest some measures that can be taken to overcome the problems mentioned before: 

1. The content of university studies should be adapted to the general scientific and technological 
progress (state-of-the-art). Students should have courses in programming languages and the use 
of data mining, computer simulation, and visualization tools. Moreover, the study contents should 
be more interdisciplinary. It would certainly advantageous to get a basic overview of complexity 
science, the social and natural sciences (e.g. network science) and engineering (e.g. cybernetics). 

2. The preselection of faculty members should better be based on relative citations rather than the 
(impact factor of the) journals one has published in. However, even more important than this is the 
assessment of the content and quality of publications written, particularly their intellectual depth 
and level of innovation. Therefore, reputation values as determined by suitable rating systems would 
be important complementary information. 

3. Recruitment committees should reward interdisciplinary research projects as well as data-oriented 
and problem-oriented research rather than the use of certain methods. 

4. The publication system should become more efficient (in terms of publication times), more trans- 
parent for innovative (heterodox) approaches, and pluralistic (scientific convergence should happen 
based on successful testing, not through selective control). 

5. Replacing journal editors by open-minded, multi-disciplinarily oriented editors may help. Accepting 
a certain percentage of heterodox papers (say 20-30%) would stimulate innovation and support 
plurality rather than narrow, unidirectional research. Journals should also support formats such as 
comments and replies, e.g. through a discussion section or by providing a corresponding functionality 
at the internet portals of the electronic journal version. Furthermore, methodological contributions 
and contributions from related fields, such as cconophysics, for example, should be sporadically 
accepted. Such contribution could be marked as guest contributions, comments, opinions, etc., 
depending on the respective kinds of contributions. Moreover, new, multi-disciplinarily oriented 
journals should be launched, using the various possibilities offered by Web2.0 platforms (see Sec. 
l2~2l . 

6. Funding agencies should reward collaborative, interdisciplinary, goal-driven research. Furthermore, 
incentives for computational, experimental and data-mining studies should be provided. 

7. Research agencies should create special funding schemes and evaluation procedures for non- 
standard, high-risk research. For example, scholarships that allow researchers to travel and to visit 
different institutions and departments would be useful. Moreover, large research grants would en- 
courage universities to recruit faculty members who were awarded with them, particularly when 
they come with overheads for the hosting institution under the condition that a permanent position 
is offered. 

8. The research cycle should be improved, creating missing links and feedback loops. The develop- 
ment of an Innovation Accelerator, as outlined in Sec. [2j would provide the right communication, 
coordination, and co-creation tools for this. 
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7.7 Final considerations: Publishers as future information brokers? 

It is quite obvious that both, the scientific system and the publication system will face major paradigm 
shifts. In fact, we are expecting "more change in the next 50 years of science than in the last 4 hundreds 
years of inquiry" [92I ]. For example, the journal business of publishers may change considerably. Journals 
could largely be replaced by self-organizing information systems, using reputation and crowd sourcing 
methods. The future role of publishers may be that of knowledge scouts or knowledge brokers, earning 
mainly on discovering and connecting information rather than on disseminating information. Thereby, 
they could play an important role for future knowledge transfer, connecting science with business and 
politics much better than it has happened in the past. In order to make this knowledge transfer successful, 
however, it will be crucial to find fair ways of sharing profits proportionally with the originators of ideas 
and inventions. 
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A Pluralistic indices promoting individuals talents 

One important question is, how the performance values Xi on multiple scales i can be translated into 
one scale. Traditionally, this is done by weighting each criterion i with a certain factor W{. This results 
in average values 



where x, = Xi/(Xj) is the value Xi, which has been scaled by the average performance (Xi). The 
individual values x can ordered on a one-dimensional scale, i.e. ranked. Such an approach, however, 
promotes average performance rather than excellence, as the latter is typically characterized by extreme 
values on one or a few rating scales, but not on all of them. In order to reward individual rather than 
average talent, two methods seem to be interesting: 

1. Similar to the world of sports, one could classify different leagues (A-league, B-league, C-league, 
etc.). The A-league could consist of those people, who are among the y% best on one scale, or among 
the 2y% best on two scales, or among the 3y% best on three scales among all competitors (where 
one could, for example, choose y = 10). The B-leage would consist of the candidates, who would 
not be good enough to meet the standards of the A-league, but would meet them for a suitably 
chosen, higher value of y. One could proceed similarly with the C-league. 

2. Political decision-makers could choose the weight they attribute to each criterion, say wi = 0.35, 
u>2 = 0.25, W3 = 0.25, and W4 = 0.15, where criterion i — 1 could, for example, be scientific 
excellence, i = 2 industrial relevance, i = 3, societal or political relevance, and i = 4 dissemination. 
An index, which would be favorable with respect to individual talent, would be 



where the values yi correspond to the values Xi, sorted according to their size in descending order. 
This formula overweights particular individual talents, i.e. it gives everyone a fair chance and rewards 
excellence in specific areas. 




(1) 




(2) 
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Both indices overcome some a number of problems of the ranking methods that are primarily used today 
(one-dimensional ones or those averaging in an individually non-differentiated way). Nevertheless, it is 
advised to use them only for preselection and give human experts the final word in the performance 
assessment, as automated procedures are not perfect and tend to overlook relevant factors (such as 
family- or health-related ones). 



B Noteworthy 2.0 Collaborative Initiatives 

B.l Crowdsourcing 

• Innocentive 

Innocentive offers a web dashboard where companies can post scientific challenges seeking for al- 
ternative solutions. Successful problem solvers get rewarded with monetary prizes. 

[http : //www . innocentive . com/ 

• Stack Overflow 

Stack Overflow is a collaboratively edited question and answer site for programmers. 
[http : / / stackoverf l ow . com/| 

• Stack Exchange 

Stack Exchange is a network of free, community-driven Q&A sites. We highlight and aggregate the 
best recent contents from our entire network here. Area 51 is a side-component of the website which 
allows the creation of new Q&A sites through an open and democratic process. 

- http : //stackexchange . com/ 

- http : //area51 . stackexchange . com/ 

• Toolbox 

Toolbox provides a web solution for knowledge sharing within topic-centric communities of profes- 
sionals. 

http: //www. toolbox. com/ 

• Corporate Executive Board 

The Corporate Executive Board delivers authoritative data and tools, best practice research, and 
peer insight to the leaders of the worlds great enterprises. 

http : // www . exe cut iveboard . com/ 

• 43 Things 

On 43 Things people can post a list of 43 goals to reach in their lives, from watching a space shuttle 
launch to grow my own vegetables. It entails a social space where people answer questions regarding 
how they achieved specific goals. 

http : //www . 43things . com/ 

• KickStarter 

Kickstarter offers an intuitive web interface for performing fund-raising for artistic, scientific and 
engineering projects. 

http : //www . kickstarter . com/ 
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• Taking It Global 

TakinglTGlobal tries to pull together people from all the world towards globally relevant issues, 
http: //www. tigweb.org/ 

• Bank of Happiness 

The purpose of the Bank of Happiness is to promote non-monetary values in order to help people 
find their way back to the deeper values. It offers a Web 2.0 site from which people can exchange 
good deeds for free. 

http : / / www . onnepank . ee/ 



.2 Content Aggregation 

• Research Blogging 

ResearchBlogging.org is a system for identifying thoughtful blog posts about peer-reviewed research. 
Users create properly-formatted research citation for the journal articles with an automated citation 
generator, then they paste a special code into their blog entry and an automated aggregator finds 
their post and publishes it on the front page. 

http : //researchblogging . org/| 

• Digg 

Digg allows to discover and share content on the Internet, by submitting links and stories, and 
voting and commenting on submitted links and stories. 

http : / / digg . com/ 

• Redditt 

Redditt allows to discover and share content on the Internet, by submitting links and stories, and 
voting and commenting on submitted links and stories. 

http : //www.reddit . com/ 

• Delicious 

A social bookmarking tool to share and tag internet references, 
http : / / www . delicious . com/ 

• Yahoo Pipes 

Pipes is a powerful composition tool to aggregate, manipulate, and mashup content from around 
the web. 

http : //pipes .yahoo . com/pipes/ 

• StumbleUpon 

Stumble Upon allows the discovery of new web content on the basis of powerful recommendation 
system applied to a vast user-base. 

http : / / www . stumbleupon . com/ 
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B.3 Project Management 

• Stakesource 

Social networking tool that automatically identifies and prioritises the stakeholders for your projects, 
engages with the stakeholders, and understands their needs. Crowdsourcing, collaborative filtering 
and prioritised lists are among the tools available here. 

http : / / www . stakesource . co . uk/ 

• Scrum 

Scrum is an agile framework for completing complex projects. Scrum was originally formalized for 
software development, but it suits well any complex and innovative project. 

http : //www. scrumalliance . org/ 

• SharePoint Workspace 2010 

Formerly known as Groove, it is a collaborative work platform used by Microsoft, 
http : //of f ice . microsoft . com/ en-us/ sharepoint- workspace/ 

B.4 Measuring Scientific Progress 

• Scholarometer 

Scholarometer(beta) is a social tool to facilitate citation analysis and help evaluate the impact of 
an author's publications. 

http : //scholarometer . indiana. edu/ 

• Liquid Pub 

This project promotes the notion of Liquid Publications which are evolutionary, collaborative, and 
composable scientific contributions. Based on lessons learnt from open source software development 
and from Web 2.0 applications, it promotes a software platform for collaborative evaluation of 
knowledge artifacts. 

[http : / /li quidpub . org/| 

• HistCite 

HistCite helps science professionals to make better use of the results of their searches of the Web 
of Science. HistCite lets you analyze and organize the results of a search to obtain various views of 
the topics structure, history, and relationships. 

[http : //www . histcite . com/| 

• Phys Author Rank Algorithm 

Phys Author Rank Algorithm is a website where physicists can check the evolution of their own 
scientific rank. Scientific rank is calculated using the Science Author Rank Algorithm on a weighted 
author citation network. 

http : / / www . physauthorsrank . org 

• Citebase 

Citebase Search is a semi-autonomous citation index for free, online research literature. Citebase 
contains articles from physics, maths, information science, and (published only) biomedical papers. 
Currently, only an experimental demo is working. 

http : / / www . citebase . org/ 
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• Publish or perish 

Publish or Perish is a software program that retrieves and analyzes academic citations from Google 
Scholar. It obtains the raw citations, analyzes them, and presents several statistics. 

http : / / www . harzing . com/pop . htm 

• Scholar Index 

Scholar index is a free service to query Google Scholar and to compute and visualize the corre- 
sponding h-index and other metrics. 

http : / / interaction . lille . inria.fr/~roussel/proj ects/scholarindex/ 

• SPIRES 

SPIRES is an eprint repository for particle and nuclear physics contributions. It displays a number 
of additional information about citations and indexes. 

http : //www . slac . Stanford . edu/ spires/ 

• SciVal 

Based on co-citation analysis, SciVal by Elsevier offers of an overview of institutions' research 
performance, indicating growing areas of multidisciplinary strength and identifying key competitors 
and potential collaborators. Not free of charge. 

.5 Scientific References Management 

• Citeulike 

Citeulike is a free service for managing and discovering scholarly references. It allows one to easily 
store references, to find new ones through recommendations and to share references with peers. 

http : //www . citeulike . org/ 

• Zotero 

Zotero is a free, easy-to-use Firefox extension for collecting, managing, citing and sharing your 
research sources. 

http : / / www . zotero . org/ 

• Mendeley 

Mcndeley is a free research management tool to organize, share and discover research papers. 
Improved services are available for charge. 

http : //www . mendeley . com 

• Connotea 

Free online reference management for all researchers, clinicians and scientists. It saves and organizes 
links to your references and shares them with colleagues. 

http : //www. connotea. org/ 

• Bibsonomy 

BibSonomy is a tags-based system for sharing and organizing lists of scientific references, 
http : / / www . bibsonomy . org/ 
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• CiteSeerX 

CiteSeerX is a scientific literature digital library and search engine that focuses primarily on the 
literature in computer and information science. Rather than creating just another digital library, 
CiteSeerX attempts to provide resources such as algorithms, data, metadata, techniques, and soft- 
ware that can be used to promote other digital libraries. The code of the engine is open source and 
downloadable. 

|http : / / citeseerx . ist . psu . edu/ 

• World Wide Science 

WorldWideScience.org is a global science gateway comprised of national and international scientific 
databases and portals. WorldWideScience.org provides one-stop searching of databases from around 
the world. A beta feature adds real-time translation of multilingual scientific literature. 

http : //worldwidescience . org/ 

• Faculty of 1000 

Faculty of 1000 Biology and Medicine are authoritative online services in which over 5,000 lead- 
ing researchers and clinicians share their expert opinions by highlighting and evaluating the most 
important articles in biology and medicine. 

|http://f 1000. com? 

• SAO/NASA ADS 

Managed by NASA, it supplies detailed bibliographic information about physics papers. Users can 
obtain on a record by record basis all the information available about a particular bibliographic entry 
(including the bibliographic code, title, authors, author affiliations, journal reference, publication 
date, category, comments, origin, keywords, and abstract text when available). 

http : / / adsabs . harvard . edu/physics_service . html 



.6 Spatial Visualization of Science 

• Living Science 

Living Science is a real-time global science observatory based on publications submitted to 
arXiv.org. It covers daily submissions of publications in areas as diverse as Physics, Astronomy, 
Computer Science, Mathematics and Quantitative Biology. Currently, contents are dynamically up- 
dated every day. Living Science is an analysis tool to identify the magnitude and impact of scientific 
work worldwide. 

http : //www . livingscience . ethz . ch/ 

• AuthorMapper 

AuthorMapper searches journal articles and book chapters and plots the location of the authors on 
a map. 

http : / / authormapper . com/ 

• Eigenfactor 

Eigenfactor offers interactive visualizations based on the Eigenfactor™Metrics and hierarchical 
clustering to explore emerging patterns in citation networks. 

- http : / /eigenfactor . org/ 

- http : //well-formed . eigenfactor . org/| 
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• Visualizing Arts and Humanities Citation Index 

The site displays the position and environment of every individual journal in A&HCI (2008) based 
on their similarities in citation patterns. 

http : //vks2 . virtualknowledgestudio . nl/ ahci/ index . html 



B.7 Scientific Social Networks and Collaborative Tools 

• Academia.edu 

Academia.edu is a system that manages publications and shows institutions and scientists in a 
graphical tree representation. It allows to follows other colleagues' work and share one's own pub- 
lications within a network of trusted peers. 

http : / / www . academia . edu 

• Research Gate 

Research Gate is a professional social network for scientists. It's free of charge, 
http : / / www . researchgate . net/ 

• BioMedExperts 

BioMcdExpcrts (BME) is a web platform to allow scientists and researchers across multiple orga- 
nizations and nations to share data and to collaborate. 

http : //www . biomedexperts . com/ 

• ResearcherlD 

ResearchcrlD is a global, multi-disciplinary scholarly research community. With a unique identifier 
to each author in ResearchcrlD, one can eliminate author misidentification and view an author's 
citation metrics instantly. ResearcherlD allows one to search the registry in order to find collabo- 
rators, review publication lists, and explore how research results are used around the world. 

http : //www . researcher id . com/ 

• Science Commons 

Science Commons designs strategies and tools for faster, more efficient web-enabled scientific re- 
search. 

http : //www . sciencecommons . org/ 

• NeuroCommons 

It is a "proof-of-concept" project from the Science Commons Initiative within the field of neuro- 
science. The NeuroCommons is a beta open source knowledge management system for biomedical 
research. 

http : / / www . neurocommons . org 

• Nature Network 

Nature Network is an online network for scientists to discuss scientific news and events, 
http : // network . nature . com/ 
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